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(54) Methods and apparatus for generating custom gamma curves for color correction 
equipment 

(57) A control point based real time primary custom 
gamma curve generator for color correction equipment. 
A separate custom gamma curve generator circuit is 
provided for each of the RBG and luminance channels. 
A plurality of control points is provided and stored in a 
lookup table (LUT) stored in a random access memory 
(RAM). The control points are set and/or adjusted by the 
operator or loaded from a prestored set (e.g. a default 
custom gamma curve). The instantaneous input signal 
is divided into two portions— a control point address 
portion comprising the most significant bits (MSBs) of 
the input signal, and an interpolation address portion 
comprising the least significant bits (LSBs) of the input 
signal. The MSBs are used to select a particular control 
point vaJue stored in RAM. The LSBs are used for inter- 
polation of values with a smooth curve between control 
points. Also described are various user interfaces for 
the custom gamma curve generator. 
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Description 
Technical Field 

5 [0001] The present invention relates generally to image processing, and more particularly relates to an improved 
method and apparatus for setting custom input/output relationships for the gain, gamma and lift parameters of the lumi- 
nance, red. green, and blue primary video signals in the primary signal processing stage of video signal color correction 
equipment in real time. 

10 Background of the Invention 

[0002] In certain types of image processing systems, especially color correction systems employed in post-production 
equipment, system operators observe a image on a video monitor, adjust color and other parameters of the image until 
it is aesthetically satisfactory, store the parameters in system memory, and apply the parameter corrections to a 

is sequence of images forming a scene. Various types of image processing are often employed to create, enhance, com- 
press, filter, or otherwise modify characteristics of an image. In a video signal color correction system, color corrections 
of motion picture film and/or video tape are typically made on a scene-by-scene basis. A "scene" is a sequential collec- 
tion of images shot from the same camera, having the same viewpoint, composed in a certain way, etc. A system oper- 
ator or "colortsf views a selected exemplary image or frame from a scene. The colorist then applies color corrections 

20 via a control panel to adjust video parameters such as hue, saturation, luminance, etc. of a frame image being viewed. 
The correction settings are stored in system memory. 

[0003] After the colorist is satisfied with the adjustments he or she has made to the selected frame, the correction 
system, which is typically computer-controlled, applies the stored color corrections to each frame in the scene one at a 
time. The color-corrected frames of the scene are then recorded on film or videotape. The steps are repeated for other 

25 scenes in the film or video tape, often with different correction settings stored for different scenes. This process creates 
a color-corrected master film or video tape that reflects color adjustments to ail frames in all scenes. 
[0004] Many types of color correction equipment employed as the source of images for processing provide signals in 
the primary colors of red, green, and blue (RGB). These signals are typically cfigital. or are digitized by digitizing equip- 
ment prior to color correction processing. In present day equipment, the primary video signals are often provided in a 

30 format promulgated by the International Radio Consultant Committee (CCIR), Recommendation No 601-1. The CCIR 
in 1986 defined a standard set of digitised color signals for television studios. CCIR Recommendation 601-1 (1986) is 
hereby incorporated by reference. 

[0005] The standard signals defined in Recommendation 601-1 essentially consist of a luminance signal Y and two 
color difference signals (R-Y) and (B-Y). It is well known that since the luminance signal contains information on levels 
35 of red, green, and blue, the three standard signals can be used to unambiguously reproduce the RGB levels for any 
given set of samples. 

[0006] It is well known that certain aspects of the RGB signals from image source equipment are nonlinear with 
respect to color imagery and that it is advantageous to adjust these aspects prior to processing with color correction 
equipment. For example, it is well known that the gain, gamma, and lift parameters of the signal from various types of 
40 image sources often need alignment or adjustment prior to processing, because of the nonlinearity of these sources. 
These parameters of gain, gamma, and lift are typically represented as a "gamma curve". 

[0007] Basically, custom gamma is a numerical factor used for indicating how light values are expanded or com- 
pressed. Typically, the relationship between the input and output of a typical video channel is graphically represented 
as a nonlinear relationshp or curve by depicting the output on the y-axis relative to the input on the x-axis. The numer- 
45 ical value of gamma is proportional to the deviation from a straight line to the curve. A curve with positive gamma value 
is bowed upward, with the greatest slope at the start and a relative flat part at the end. A curve with negative gamma 
value is bowed downward, making the start of the curve comparatively flat while the steeper slope is at the end. A 
gamma of zero results in a straight line, with a constant slope. 

[0008] The gain parameter on a gamma curve represents numerical multiplicative factor at the highest output level 
so relative to the highest input level. For example, if an input signal reaches a peak level of 1, and the output signal is at 
1 .5. the gain is therefore 1 .5. 

[0009] The black level or lift parameter of a gamma curve is a function of the output signal for the lowest value of input 
signal. If the input signal is or is supposed to be 0. which represents a black region ol an image, but the image source 
equipment provides a positive output value for the zero input signal, the signal is said to experience a "lift" or an 
55 increased black level. This is also the point at which the gamma curve intersects the y-axis. Often, the lift must be 
adjusted in each of the RGB channels so as to provide a uniform black 

[0010] It is known in the art to provide customized gamma curve equipment at the input stage of color correction 
equipment so as to provide for gain, gamma, and black level adjustment for signals from various image sources. The 
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Renaissance 8:8:8™ color correction equipment is a computer-controlled color correction system manufactured by the 
assignee of the present invention. This system allows an operator to define gamma curves for each of the RGB and 
luminance channels in a customized manner. The "Custom Curve" feature of the Renaissance 8:8:8™ equipment allows 
the operator to adjust the shape of gamma curve by software manipulation, via a graphical user interface. These curves 
5 can be altered beyond the standard amount of "stretch" or "crush". Without affecting the value of middle grays in an 
image, the Custom Curves feature adds extra density to the darker shadows while allowing compression of the tonality 
range of highlights. This enhances middle contrast and simultaneously avoids clipping, and produces richer, vibrant 
colors. 

[001 1] The known Custom Curves feature also allows an operator to select a point along a custom gamma curve and 
10 independently pull on each color channel's primary balance without regard to what might be occurring at any other level 
of color enhancement. This allows creation of a totally unique gray scale response for each color channel. 
[0012] With the Custom Curves feature, an almost unlimited variety of primary color effects are possible. The Ren- 
aissance 8:8:8™ equipment allows an operator to switch, dissolve, or window between various effects on a scene by 
scene basis. The Custom Curves can be defined differently for each color correction session and then stored independ- 
15 entiy and automatically. 

[001 3] To allow user access to the Custom Curves feature, operator controls are provided on the Renaissance 8:8:8™ 
control panel. A number of "soft keys" (actuataWe buttons on a display screen associated with the computer-controlled 
equipment) allow selection of a particular custom gamma curve for channels, for example of luminance, red, green, and 
blue. A Custom Curves features window appears on the operator's workstation window. The operator can visually 

20 inspect the shape of the gamma curve for the luminance, red, blue, and green channels. The custom gamma curves in 
this prior system can also be selected by clicking directly on a curve using a pointer and mouse. To create or adjust a 
custom gamma curve, the operator places the cursor on an appropriate curve, holds down the left mouse button, and 
drags the curve to a new shape. The operator can also place the cursor at the point in the display window for the curve 
and click; the curve will snap to that location. A colored defined "control point" dot appears as the user interface feed- 

25 back at the new position on the curve. In this prior system, up to four defined control points can appear on each curve. 
[001 4] Similarly, to delete a defined control point on a custom gamma curve, the operator places the cursor on or near 
the point and double-licks the left mouse button. Double-clicking the left mouse button while the cursor is on a custom 
gamma curve sets the curve to unity, which as described above is a straight line. At unity, of course the gamma control 
has no effect. 

30 [001 5] The setting of each custom gamma curve in this prior equipment can be saved to five user memories per color 
channel. The operator can assign a name or a comment to the curve by clicking in a comment area and typing in an 
appropriate text message. A sixth soft key button recalls a default curve, which is not adjustable. Thus, a set of five user 
memories are provided per color channel, storable in a configuration file. 

[001 6] In the prior Renaissance 8:8:8™ Custom Curves equipment the process of defining the curve is computation- 
's ally and memory intensive. A large lookup table comprising a 16K x 16 is provided for storing all possible values of the 
custom gamma curve for all possible values of a 14-bit input signal, which allows storage of a discrete value for the cus- 
tom gamma curve for each of R, G, B t and luminance. 

[0017] A significant problem with this approach is that the entire 16K x 16 array must be computed and loaded for 
each different custom curve for each channel; changing a custom curve to implement an effect between one frame and 

40 the next entails loading all values of the entire array in a very short time. It has proven impractical to recompute and refill 
a 16K x 16 bit array on a per-frame basis, thereby effectively limiting the effects that can be implemented. 
[0018] Moreover, for instantaneous small values of gamma (i.e. steep slopes), there can be discontinuities between 
bitwise adjacent values of the input signal, notwithstanding the 14-bit resolution. This is because of the basic piece-wise 
linear approach of storing discrete values. Such discontinuities can result in noticeable artifacts in the output signals. 

45 [001 9] Accordingly, there is still need for improvement in the custom gamma curve type feature in the primary channel 
processing for color correction equipment that provides superior performance for real time image processing. There is 
also a need for a improved custom gamma curve generator that generates a smooth curve through a fixed number of 
arbitrarily defined control points. 

so Summary of the Invention 

[0020] The present invention provides an improved control point based real time primary custom curve generator for 
color correction equipment A separate custom gamma curve generator circuit is provided for each of the RGB and 
luminance channels. A plurality of control points (32 in the disclosed embodiment) is provided and stored in a lookup 
55 table (LUT) stored in a random access memory (RAM). These control points are set and/or adjusted by the operator, or 
loaded from a prestored set (e.g. a default custom curve). The instantaneous input signal is divided into two portions— a 
control point address portion comprising the most significant bits (MSBs) of the input signal, and an interpolation 
address portion comprising the least significant bits (LSBs) of the input signal. The MSBs are used to select a particular 
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control point value stored in RAM. The LSBs are used for interpolation of values with a smooth curve between control 
points. 

[0021] In the disclosed embodiment with a 14-bit input signal resolution, the 5 MSBs are used to select one of 32 
possible control point values. The 9 remaining LSBs are used to select interpolation function values. 

5 [0022] A predetermined interpolation function is precatetdated and stored in a read only memory (ROM) lookup table; 
the interpolation is based on a control point before and a control point after a given control point selected with the MSBs. 
[0023] The output of the control point lookup table for a particular control point is then multiplied with its corresponding 
interpolation function value from the interpolation function ROM lookup table. The results of all the taps are added to 
form the final interpolated sample. The output is a smooth transition between the control point value immediately pre- 

10 ceding a given control point and the control point value immediately following the given control point. 

[0024] With the present invention, an operator can provide a number of different custom gamma curves for various 
types of image source equipment, and can provide custom sets of custom gamma curves to provide various effects on 
the primary color channels in a real time basis. The primary custom gamma curve generator can operate on a real time 
basis to implement and provide these primary effects prior to any subsequent color correction. 

is [0025] Also provided in the present invention is a special gamma curve "knee" function generator. This knee function 
generator allows creation of a custom gamma curve "bump" or "knee" that can be positioned anywhere along the 
gamma curve. The bump or knee can be adjusted in location, width, and slope so as to provide a localized "subgamma 
curve." This facilitates implementation of custom localized gamma curve effects at any point desired by an operator. 
[0026] Also provided in the present invention are improved user interfaces for a system incorporating the described 

20 control point based real time primary custom gamma curve generator. The improved user interfaces allow several dif- 
ferent "views" or approaches to setting the gain, gamma, and lift of a custom gamma curve. 

[0027] These and other features and advantages of the present invention may be more clearly understood and appre- 
ciated from a review of the following detailed description of the disclosed embodiment and by reference to the appended 
drawings and claims. 

25 

Brief Description of the Drawings 
[0028] 

30 FIG. 1 is a block schematic diagram of an image processing system suitable for employment of the custom gamma 
curve generator constructed in accordance with the preferred embodiment of the present invention. 
FIG. 2 illustrates a user interface screen for displaying custom gamma curves and allowing operator control of 
same. 

FIG. 3, consisting of FIGS. 3A through 3C, illustrates a subgamma curve or "knee" with controllable aspects of knee 
35 position, knee width, and knee slope. 

FIG. 4 illustrates an exemplary custom gamma curve for the red channel, with an illustrative interpolation curve 
applied to a selected set of control points. 

FIG. 5 is a schematic diagram of the custom curve generator circuit constructed in accordance with the preferred 
embodiment of the present invention. 
40 FIG. 6 illustrates an alternative user interface screen for the described custom curves generator. 
FIG. 7 illustrates an alternative user interface screen for the described custom curves generator. 

Detailed Description of the Disclosed Embodiment 

45 [0029] Referring now to the drawings, in which like numerals indicate like elements or steps throughout the several 
figures, FIG. 1 illustrates an image processing system 1 0 constructed in accordance with the preferred embodiment of 
the present invention, suitable for employing the custom gamma curves invention described herein. 

Preferred Embodiment of Color Correction System 

so 

[0030] Although the present invention will be described in the context of a scene by scene digital color corrector, it will 
be understood that the inventions described herein are not limited to video color correction and are equally useful in 
other types of systems, particularly image processing equipment, where there is a need for adjustment to nonlinear 
aspects of signals prior to subsequent signal processing. However, in the context of the disclosed embodiment, the 
55 inventions are particularly useful in a scene by scene color corrector where a plurality of frames comprising a scene 
must be viewed and adjusted to create or modify a video program such as a movie, commercial, television program, etc. 
[0031 ] An image processing system 1 0 constructed in accordance with the preferred embodiment comprises several 
basic components— a computer-based workstation 12 including monitor 15 and keyboard 20. a colorist's control panel 
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25. a digital color correction system 30. a source of images 32. a video display 40. and a destination for corrected 
images 42. The workstation 1 2 preferably includes pointing devices such as a mouse 18 and/or graphics tablet 1 9. The 
workstation 12 is coupled for data communications via a network connection 22. preferably a high speed network such 
as Ethernet to the color correction system control panel 25 and color correction system 30. 

5 [0032] The source of images 32 may be a telecine. video tape player, or a digital video storage medium. The source 
is connected to an Input circuit board 31 in the color correction system 30. It will be understood that the image signals 
internal to the color correction system 30 are digital, and are stored and manipulated in a digital video format such as 
the International Radio Consultant Committee (CCIR) promulgated Recommendation No. 601-1 which defines a stand- 
ard set of digitized color signals. CCIR Recommendation 601-1(1986) is hereby incorporated by reference. It is known 

10 in the art to take CCIR 601-1 digitized signal streams, convert same to corresponding RGB signals (in analog or digital 
domains), and then to perform the primary and secondary color corrections and modifications on the resultant signals. 
The corrected or modified signal can then be passed through a signal matrix and reconverted to a digital bit stream 
through use of an analog to digital converter. The standard signals defined in Recommendation 601-1 essentially con- 
sist of a luminance signal Y and two color difference signals (R-Y) and (B-Y). It is well known that since the luminance 

is signal contains information on levels of red, green and blue (RGB), the three standard signals can be used to reproduce 
the RGB levels for any given set of samples. 

[0033] For purposes of the description of the present invention, the primary color signals red, green, and blue (RGB) 
will be described as the subjects of the custom gamma curves, although it will be understood that the source signal may 
be in the original form of Y, R-Y, and B-Y. 
20 [0034] A custom gamma curve circuit 33 constructed in accordance with the present invention is provided to receive 
the RGB signals and implement the custom gamma curves as described herein. The output of the custom gamma 
curve circuit is provided to other components of the color correction system 30 which do not form a part of the present 
invention. 

[0035] An Output circuit board 35 is provided as a part of the color correction system 30, and typically converts the 
25 digital signals after processing within the color correction system back into analog form for display. The Output circuit 
35 is coupled via a video signal cables 37 to a video monitor 40 and to a utilization device 42 such as a video tape player 
or other image storage devica Alternatively, the corrected digital signals can be stored in digital form in a digital data 
storage device coupled to the system. 

[0036] The preferred workstation 12 is an INDY™ model workstation manufactured by Silicon Graphics, Inc. (SGI). 

30 The preferred workstation includes an R4600 RISC processor operating in excess of 133 MHz, internal 24-bit XL color 
graphics (with RGB single or double buffer color indexes), a digital video input port capable of storing 640 x 480 x 30 
fps to memory, 2 serial and 1 parallel data port, an Ethernet network port, a fast SCSI-2 data port at least 32 mega- 
bytes of RAM, and a 1 .0 or larger Gb hard disk. Optionally, a different SGI model workstation could be employed, e.g. 
one including a video adapter card that allows support and use of multiple monitors. Further details of the preferred 

35 workstation are available in the literature supplied by the manufacturer. 

[0037] The preferred workstation 12 includes on-board display driver circuit, namely, the 24-bit XL color graphics cir- 
cuitry with RGB double buffer color indexes, which provides video signals to at least one workstation monitor 15. A sep- 
arate, second video monitor 40 is utilized in the preferred embodiment to cfisplay a target image, that is, a full screen 
representation of the video image being processed in the system. H a workstation model is employed that supports mul- 

40 tiple monitors, the second monitor 40 may be connected to the workstation 12. 

[0038] The preferred graphics tablet 19, which is particularly useful for certain manipulations in color correction sys- 
tem, is a Wacom ArtPad™ or ArtZ™ graphics tablet manufactured by Wacom Technology Corporation, Vancouver. WA 
98661. 

[0039] The preferred color correction system 30 is a Da Vinci RENAISSANCE 8:8:8™ digital color corrector manufac- 
45 tured by Da Vinci Systems. Inc.. Ft. Lauderdale, Florida. This color correction system includes various circuit board 
components that are employed to carry out digital video signal processing and is coupled to the control panel 25. The 
preferred RENAISSANCE 8:8:8™ control panel 25 comprises three separate panels each having a combination of ded- 
icated keys, soft keys, and soft knobs that provides many simultaneous functions utilized in the color correction process. 
A dedicated keyboard 50 contains both dedicated and soft keys for system feature control, display/list management, 
so source and destination motion control, editing, special effects features, and the like. This keyboard also contains a slide- 
out alphanumeric keyboard (not shown) to enter names, comments, and other important session information. Included 
on this control panel is a "Custom Curves" button or key 51 that is utilized to activate the functions described herein. 
[0040] it will be understood that the preferred RENAISSANCE 8:8:8™ system includes software that is operative for 
controlling the image source and destination, and reading and storing frame numbers in association with user-defined 
55 scene identifiers or names. Thus, the system is able to provide displays of scene lists that facilitate the user in associ- 
ating scene identifiers or names with exemplary images from the scene. 

[0041] The control panel 25 further includes a joyball panel 53, which includes knobs, a trackball 54 for manipulating 
a cursor, keys for source setup, primary color balance, color grabbing, trackball control, and other effects control. When 
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the windows feature of the present invention is activated, movement of the trackball 54 causes generation of a cursor 
110 that is displayed on the video monitor 40. The cursor 1 1 0 is utilized to manipulate and control aspects of the custom 
curve generator, as will be described. 

[0042] Finally, the control panel 25 includes a soft panel 57, which contains knobs and soft keys for dedicated 6-color 

5 secondary enhancement, special effects control, dedicated memory keys, and other functions not forming a part of the 
present invention. It will be understood that the provision of primary and secondary color correction, and sets of primary 
and secondary color correction, can be set and stored in memory by manipulation of controls on the soft panel 57. 
[0043] The color correction system 30 preferably also includes several circuit boards that provide the functions 
required to carry out color correction or other types of image processing in the digital domain, and to control input from 

to the image source 32 and utilization or storage in the utilization device 42. These circuits include a real time controller 
(RTC) circuit 70 with network interface that provides a data communication network interface to the data communication 
network 22 coupling the color correction system 30 to the workstation 12 and color correction system control panel 25. 
[0044] The real time controller (RTC) 70 includes a dedicated microprocessor for handling real time events. Real time 
events occur at the rate of one every 30 millisecond (ms). so as to maintain an event rate corresponding to at least a 33 

is frames per second (fps) display rate. Data comprising an events list is provided to the RTC 70 via the data communica- 
tions network 22; this events fist is provided to control various functions of components in the system, for example pro- 
viding a set of color corrections for each frame of a specified scene being processed. In particular, the events list as 
employed in the present invention includes a data structure that identifies a particular frame number and scene number, 
information that specifies one or more user defined windows for the particular frame, information identifying color cor- 

20 rections to be applied to areas inside the one or more windows of the particular frame, and information identifying color 
corrections to be applied outside the window of the particular frame, and other information. 

[0045] The events list in the preferred embodiment is a data structure having frame numbers as a time reference. The 
data structure comprises a sequence of data blocks, each block being related to a beginning frame number and an end- 
ing frame number. Each block is called a "scene" which corresponds to a continuous segment of film or video shots. 

25 Each block also contains a set of color correction parameters and window parameters. The color correction parameters 
include known parameters such as red gain, red gamma, red black, eta, for each RGB color channel. 
[0046] A user definable windows (UDW) generator board 75 includes a dedicated high speed microprocessor that 
converts vectorized user defined windows into a video matte or key on a real time basis at the real time event rate. The 
RTC circuit 70 provides the vector representations of the windows to the UDW board 75 at the real time event rate. 

30 [0047] A key frame buffer (KFB) circuit board 78 stores a video image from the image source 32, or from any other 
digital storage system, in a high speed memory. This image is then utilized to derive a vector representation of any user 
defined windows. Keys for vectorizing may be obtained directly from the image source 32 or be retrieved from prestored 
images stored in the memory of the workstation 12. 

[0048] Further description of the UDW generator is provided in U.S. patent application Serial No. 08/912,662, filed 
35 August 8, 1997, entitled "User Definable Windows for Selecting Image Processing Regions," the disclosure of which is 
incorporated herein by reference and made a part hereof. 

[0049] Color correction circuit 80 carries out digital color correction and other video parameter adjustment functions 
associated with the color correction system 30. The block in FIG. 1 identified as the color correction circuit 80 includes 
all of the remaining functions of the preferred RENAISSANCE 8:8:8™ digital color correction system 30, and will not be 
40 discussed further. Details of the operations and functions of the preferred color correction system 30 are available in the 
literature supplied by the manufacturer. 

[0050] As will be understood by those skilled in the art. the preferred color correction system 30 is operative to receive 
video images from an image source such as telecine 32, digitize the video images, effect gamma curve correction on 
the primary RBG video signals, capture a digitized image in the KFB board 78, display the captured image on the video 
45 monitor 40. receive color corrections entered by the colorist or operator via the control panel 25. impose such color cor- 
rections upon video images as they are transfened through the system, and provide corrected output signals via the 
output board 35 which are employed or stored in a utilization device 42 and/or simultaneously displayed on the video 
monitor 40. 

[0051] In carrying out the operations for applying image processing, a system operator or user interacts with the sys- 
50 tern through the control panel 25, and via the user interface elements of the workstation 12, namely, keyboard 20, 
mouse 18. graphics tablet 19. and workstation monitor 15. In particular, the workstation 12 executes computer pro- 
grams for carrying out the computer-implemented methods described herein, and generates displays on the monitor 15 
containing windows with user interface elements such as informational displays, control buttons, slider bars, data entry 
fields, image display areas, etc. 
55 [0052] The reader should be careful here to distinguish user-interface "windows" displayed on the monitor 1 5 gener- 
ated from execution of computer software for carrying out the custom gamma curves invention from the "user defined 
windows" for applying image processing. During system use, the workstation monitor 15 will typically be displaying one 
or more user-interface oriented windows for carrying out the methods as described herein. One such user-interface 
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window is a control window 44, which comprises a display of various buttons and slider controls for manipulation of a 
key image. Activation of certain commands causes the display of other, secondary windows. One of the secondary win- 
dows is a Custom Curve window 46, shown overlapping the control window 44 in FIG. 1 . The Custom Curve window 46 
is used to display aspects of custom gamma curves in accordance with the invention. 
5 [0053] In the disclosed embodiment, the results of image processing are viewed on the video monitor 40, while the 
user interface and controls aspects of the image processing and the invention are carried out through the workstation 
1 2 and its associated monitor 15. 

Overview of Custom Gamma Curves 

10 

[0054] Turn next to FIG. 2 for an overview of custom gamma curves as implemented in the preferred embodiment of 
the present invention. 

[0055] It should be understood that in the following discussion of methods involved in the present invention, numerous 
details are provided such as computer display system elements, aspects of computer program user interfaces, display 
15 screens and formats, sample data, etc. in order to provide an understanding of the invention. However, those skilled in 
the art will understand that the present invention may be practiced without the specific details. Well-known circuits, pro- 
gramming methodologies, and structures are utilized in the present invention but are not described in detail in order not 
to obscure the present invention. 

[0056] Certain of the method descriptions which follow are presented in terms of exemplary display images, algo- 

20 rithms, and symbolic representations of operations of data within the computer's memory. As will be known to those 
skilled in the programming arts, and particularly those skilled in object-oriented programming methodologies, these 
algorithmic descriptions and graphic exemplary displays are the means used by those skilled in the art of computer pro- 
gramming and computer construction to convey teachings and discoveries to others skilled in the art 
[0057] For purposes of this discussion, a "algorithm" is generally a sequence of computer-executed steps leacfing to 

25 a desired result These steps require physical manipulations of physical quantities. UsuaJly, though not necessarily, 
these quantities take the form of electrical, magnetic, or optical signals that are capable of being stored, transferred, 
combined, compared, or otherwise manipulated. It is conventional for those skilled in the art to refer to these signals as 
bits, values, elements, symbols, characters, images, terms, numbers, or the like. It should be kept in mind, however, that 
these and similar terms should be associated with appropriate physical quantities inside the computer and that these 

30 are merely convenient labels applied to these physical quantities that exist within the computer. 

[0058] It should also be understood that manipulations within the computer are often referred to in terms such as add- 
ing, comparing, moving, etc. which are often associated with mental operations performed by a human operator. It must 
be understood that no involvement of a human operator is necessary or even desirable in many aspects of the present 
invention, since the operations described herein (except those specifically identified as origination with the operator or 

35 user) are machine operations performed in conjunction with a human operator or user that interacts with the computer. 
The machines used for performing the operation of the present invention, as will be understood, include general pur- 
pose digital computers or other similar computing devices. 

[0059] Furthermore, it should be kept in mind that there is a distinction between the methods, steps, or operations 
carried out by a computer, and the method of computation itself. The present invention does not involve a method of 

40 computation. The present invention rather reJates to methods, steps, or operations for a computer and processing elec- 
trical or other physical signals to generate desired physical signals and display results and interactions. As illustrated in 
FIG 1, the present invention also relates to a system 10 for performing these operations. Furthermore, it should be 
understood that the programs, algorithms, etc. descrbed herein are not related or limited to any particular computer or 
apparatus. Rather, various types of general purpose machines may be used with programs constructed in accordance 

45 with the teachings herein, and employed as the workstation 12. Similarly, it may prove advantageous to construct spe- 
cialized apparatus to perform the method steps described herein by way of dedicated computer systems with hard- 
wired logic or programs stored in nonvolatile memory such as read only memory. 

[0060] FIG. 2 illustrates in more detail the custom curve window 46 displayed on the workstation monitor 1 5. The cus- 
tom curves window preferably comprises a view of the gamma curves, e.g. curve 60 of the luminance, red, green, and 
so blue channels. The value of lift can be seen as the point at which each curve crosses the y (output) axis, while the gain 
is the highest value of y (output). All of the curves show a generally downwardly-opening (concave down) type curve, 
indicating a gamma of less than one for most points along the curve. A plurality of control points (CP) are shown, all of 
which are selectable by the operator using the cursor such as that shown at 110. 

[0061] In accordance with one aspect of the invention, note that the gamma curve for the blue channel has a bump 
55 or knee 62, indicative of a subgamma function applied to the blue channel. The position, width, and slope of this knee 
is controlled by three knee sliders 65 labeled as knee position, knee width, and knee slope, respectively. Three knee 
sliders are provided for each of the luminance, red. green, and blue channels One or more knees may be provided in 
accordance with the present invention. 
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[0062] The custom curve window 46 further includes selectable tabs 48 that allow the operator to select different types 
of user controls for the custom gamma curve featura These tabs may be actuated in the known manner by pointing with 
the cursor and clicking. Clicking on the "bars" tab causes display of a "Bars" display as shown in FIG. 6. Clicking on the 
"Values" tab causes display of a "Values" display as shown in FIG. 7. Clicking on the "User Curve" tab causes display 
5 of the shape of the user curve as shown in FIG. 2. 

[0063] FIG. 3 illustrates the aspects of knee position, knee width, and knee slope in greater detail, in the context of a 
single channel (for example red). This illustrates the manner in which the operator can control the aspects of the posi- 
tion, width, and slope of a given subgamma curve or knee, as will be described. 

[0064] In FIG. 3 A, the parameter of "knee position" can be adjusted to change the location of a subgamma curve 62. 
10 Adjustment of the knee position slider control in the user interface changes the position of the knee 62 in the BEFORE 
column to that of 62' in the AFTER column. The effect is to change the location (i.e. values) of the various control points 
(CP) that define the knee. Other control points are not affected by the adjustment 

[0065] In FIG. 3B. the parameter of "knee width" can be adjusted to change the width of a subgamma curve 62. 
Adjustment of the knee width slider control in the user interface changes the width of the knee 62 in the BEFORE col- 
ts umn to that of 62* in the AFTER column. The effect is to change the location (i.e. values) of the various control points 
(CP) that define the knee. Other control points are not affected by the adjustment 

[0066] in FIG. 3C, the parameter of "knee slope" can be adjusted to change the stretch or degree of slope of a sub- 
gamma curve 62. Adjustment of the knee slope slider control in the user interface changes the instantaneous slope of 
the knee 62 in the BEFORE column to that of 62' in the AFTER column. The effect is to change the location (i.e. values) 

20 of the various control points (CP) that define the knee. Other control points are not affected by the adjustment. 

[0067] FIG. 4 illustrates an exemplary custom gamma curve 60 for the red channel, and the manner in which triples 
of the control points CP are employed to compute the interpolation between control points. As described above, up to 
32 control points are provided in the disclosed embodiment; each of these control points can be selectively moved by 
the operator by dragging them up or down in y (output). Alternatively, the control points may be adjusted by the slider 

25 controls 65 for knee position, knee width, and knee slope, or the numeric values of the knee position, knee width, and 
knee slope can be adjusted as will be described in later user interface screens. 

[0068] In accordance with one aspect of the invention, the custom gamma curve generator circuit 33 is operative to 
compute and apply a non-linear interpolation function between a control point immediately preceding a given control 
point and a control point immediately subsequent to a given control point. The five most significant bits of the 14-bit 
30 input value are employed to select one of the 32 control points, while the remaining 9 bits are employed in the interpo- 
lation function. 

[0069] Assume in FIG. 4 that the 3 control points (CP) R(n), R(n+1), and R(n-1) are involved in determining the instan- 
taneous output value as adjusted by a custom gamma curve. With a gamma = 1 , the gamma curve would be a straight 
line, as shown in the lowermost left hand portion of FIG. 4. 

35 [0070] If the central control point R(n) were adjusted (but the values of R(n+1) and R(n-1) were not adjusted), without 
the present invention, a piece-wise linear representation would occur as shown in the lowermost central portion of FIG. 
4. Note the discontinuity at R(n) which occurs because of the use of piecewise linear segments. If the slope of R(n-1) 
to R(n) was high (steep) relative to the slope of R(n) to R(n+1), a small change in the input signal near R(n) could result 
in a visual artifact due to the discontinuity. 

40 [0071] In accordance with the present invention, however, a smooth curve is drawn between the three control points. 
As shown in the lowermost right hand portion in FIG. 4. a smooth curve is drawn between the values of R(n-1). R(n), 
and R(n+1) as the result of application of an interpolation function for input values of the red signal. Therefore, small 
changes in the values of the input signal do not cause artifacts in the output signal, as there are no discontinuities at or 
near the control point values. 

45 [0072] The preferred embodiment employs a "sine" function for the interpolation function. The preferred mathematical 
relationship is as follows: 

sin(x) 1+cos(x) 
x ' 2 

so 

[0073] Those skilled in the art will understand and appreciate how to compute this function and store the values in a 
memory such as a read only memory (ROM). This interpolation function is computed and applied as a function of the 
9 LSBs of the instantaneous value of the input signal, e.g. the red input video signal. 
55 [0074] Exhfoit A is a C++ printout of this interpolation function. 

[0075] Those skilled in the art will understand that other types of interpolation functions can also be employed, so long 
as the objective of a smooth (continuous) transition between plural control points is effected. 

[0076] FIG. 5 illustrates a typical circuit 33 for computing a custom gamma curve for a typical channel, e.g. red. It will 
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be understood that a separate circuit 33 is provided for each of the luminance, red, green, and blue channels, but only 
the red channel will be described. The input signal for the circuit is a 14-bit digital signal provided on line 150. 
[0077] The custom gamma curve generator 33 circuit comprises a first control point store 21 0 for storing the value of 
the control point R(n), a second control point store 21 2 for storing the value of the immediately subsequent control point 

5 R(n+1), and a third control point store 214 tor storing the value of the immediately preceding control point R(n-1). These 
control point stores are all preferably constructed with high speed random access memory, with 32 locations, that are 
accessed by addressing with the most significant five bits ol the 14-bit input signal as provided on lines 151 . 
[0078] Each of the control point storage memories 210. 212, 214 is loaded with a LOAD signal with the digital value 
of the control point produced as a result of operator control such as adjusting a slider control, actually entering a value, 

10 dragging on a control bar, as win be described. The value of the control point is established by operator interaction via 
a user interface to software that controls the display of the custom gamma curves, as shown in FIG. 2. 
[0079] The preferred sine interpolation function is precalcutated and stored in interpolation read only memories 
(ROM) 220, 222, 224. The least significant 9 bits of the 1 4-bit input signal are provided on lines 153 to address these 
ROMs. The interpolation ROM 220 for the control point R(n), the interpolation ROM 222 for the immediately preceding 

15 control point R(n-1), and the interpolation ROM 224 for the immediately subsequent control point value R(n+1). The 
instantaneous value ol the input signal is thus used to address the interpolation ROMs and obtain an interpolation factor 
that is applied to the values of the three control points R(n), R(n-1). and R(n+1). 

[0080] The outputs of the interpolation ROMs 220, 222, 224 are applied respectively to the values of the respective 
control pants, e.g. the output of the interpolation ROM 222 for the control point R(n-1) applied to the value of the control 

20 point R(n-1) as obtained from the control point store 214 for the value R(i>1). 

[0081] The interpolation function is applied by multiplying the interpolation factors from the interpolation ROMs by 
their respective control point values and then summing the results. The outputs of the control points stores and interpo- 
lation values are multiplied with multipliers 230, and summed with an adder 235 to form the output signal e.g., Red Out- 
put Preferably, a 14-bit output signal is maintained. 

25 [0082] Those skilled in the art will now appreciate that the custom curve circuit 33 allows an operator to set and adjust 
the value of a control point and still effect a smooth, continuous transition between values of the input signal. 
[0083] In accordance with another aspect of the invention, an operator may adjust the control points comprising the 
custom curves in a variety of different manners. In the user interface of FIG. 2, the operator may adjust the location of 
any one of the 32 control points for any one of the luminance, red, green, and blue channels by clicking on a control 

30 point and dragging the control point in the y-cfirection (up or down). H desired, the operator may manually create a 
"knee" such as that shown at 62 by moving a plurality of control points to define the knee graphically. 
[0084] If desired, the operator may create and adjust a knee (e.g. such as knee 62) by manipulating one or more of 
the knee control sliders 65 for a selected channel. Moving one of the knee control sliders such as knee position, knee 
width, and knee slope automatically adjusts the values of a plurality of control points, obviating control of the control 

35 points one point at a time. Some operators may find this type of control preferable to separate control of the control 
points by pointing and clicking. 

[0085] The system is responsive to the operator's interactions to determine the values of the control points for the 
respective channel being viewed and manipulated, and store the values in the memory of the workstation 12, in asso- 
ciation with a particular scene or frame of a scene rf desired. The values of the custom curve are then automatically 
40 retrieved from memory of the workstation and loaded into the RAM of the custom curve circuit in real time, on a frame 
by frame basis if desired. A system constructed as described herein is not limited to any particular number of custom 
gamma curves, or any particular shapes; the only limit is the amount of memory made available in the workstation 
memory for storing custom curve information. 

[0086] FIG. 6 illustrates an alternative selectable user interface entitled "Bars" for the black, gamma, gain and "knee" 
45 parameters. A separate appropriately color-coded bar (e.g. gray for luminance, red for the red channel, blue for the blue 
channel, and green for the green channel) is provided for each of these parameters. The operator can adjust the black, 
gamma, gain, or knee parameters for each of these channels by clicking on an appropriately colored bar associated 
with a particular parameter to be adjusted, and dragging the upper or lower limits of the bar upwardly or downwardly. 
The respective values of the control points will adjust correspondingly. 
so [0087] FIG. 7 illustrates yet another alternative and selectable user interface for the custom gamma curves equipment 
entitled "Values." This user interface allows an operator to enter an actual value via typing at a keyboard for the param- 
eters of black (lift), gain, and gamma, knee position, knee width, and knee slope, for each of the luminance, red. green, 
and blue channels. Adjustment of the actual digital values causes the control point values to be adjusted accordingly. 
[0088] Those skilled in the art will understand how to program the workstation 12 to effect these various user inter- 
55 faces. 

[0089] In view of the foregoing description of the preferred embodiments of the present invention, other embodiments 
will suggest themselves to those skilled in the art. Therefore, the scope of the present invention is to be limited only by 
the claims set forth below. 
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•include <stdio.h> 
•include <math.h> 
•include <conio.h> 
•include <stdlib.h> 

5 

•define RESOL 4096 

•define HIBITS 32 //the number of control points 

■ define LOBITS (RESOL/HIBITS ) //the number of fractional positions 
•define PHBTTS RESOL //the resolution of the interpolation function 
•define PI 3*. 14159 

•define POINTS 3 //the interpolation aperture 

10 T 

//This calculate the interpolation function 

int interp_function( float x ) 

( 

if { x == 0) return < FNBITS ) ; 
// else return( (int) [ FNBITS • sin(x • POINTS/ { POINTS- 1) ) / <x * POINTS/ ( POINTS- 1 J ) ) * ( I 

os(x) J/2) ; 

else return ( (int) ( FNBITS * sin(x >/(x))M 1 *_cos(x) )/2) ; 

) 



IS 



void main( void ) 
( int v, i , p, sum ; 
20 int fn{ LOBITS )( POINTS ) / 

float x , angle ; 
int tableC HIBITS J. out ; 

rlLS *fpl. *fp2, *fp3, *fp4, *fp5. *fp6, »fp7; 



25 



40 



fp3 » f open I •sync_nl.dat" . "w+" ); 

fp4 = fopen( •sync_0.dat ■ , ) ; 

fp5 = fopen{ "sync_pl.dat" , ) ; 

fp7 = fopenf 'sync_func.dat " . *w+ m ); 



printf ( " Interpolation. . \n" ) ; 

fort v = 0; v < LOBITS; v*-+) 
( 

30 angle = ( float )v * 2 /POINTS /LOBITS ; 

fort i = 0, sum ■ 0 i < POINTS; i** ) 
{ 

x = (1 - 2*( POINTS - (float) i - 1 ) /POINTS ) - angle 
//printf <"x=%f a=%f\n"\ x. angle) ; 
x PI ; 

fn(v) (i) = interp_function( x ) ; 
35 sum fn(v) (i) ; 

) 

fort i * 0 ; i < POINTS; i** ) 
C 

fn[vjti] = (fn(vJIi) • FNBITS) /sum ; 

) 

. for( i a 0, iuei = 0 ; i < POINTS; i** ) 
( 

sum -*-=fn lv) (i) ; 

> 

//Correct the gains 
if (sum ==• FNBITS-1 ) 
( 

45 fn(v) [POINTS/2 ) « 1 ; 

sum >=1 ; 

) 

else 
C 

SO 



55 



* EXHIBIT 
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if [ sun == FNBITf » 
t 

fn(v) (POINTS/ 2 ♦ 
fn(v) (POIHTS/2 JW; 
sum ♦= 2 ; ) 

) 

£or( i = 0; i < POINTS; ) 
{ 

fprint£<f P 7. "%d\n" . fn(vMi] > ? 

•) 

// printfC %d \n". sum ) ; 
// getch<) ; 

Fpr intf ( f p3 . "%d\n" , fn(v) ( 0) ) ; 
fprintf (fp4. '%d\n-,fn(vj (1)) ; 
Fprintf ( Cp5 . -%d\n" , fn(v] (2) ) ; 
) 

a rand ( 0 \ ; 

£p6 = fopen( " control.dat 

fort V = 0; v < HIBITS; ) 
( 

//gamma table 

tabletv) = (int){ FNBITS • pow( v-POINTS/2 . 0 . 45) /pew (HIBITS- 1. 0.45) ) 
fprintf (fp6, '%d\n'. table tv]); 
//random numbers 

//table(v) = (int) ( ( (float) rand() • FNBITS )/ RAND.MAX) ,- 

) 

//You can import results file Data.txt into Excel 1 to get a graph 
fpl = fopen( -INPUT. daf . "w** ) ; 
fp2 = fopen( "OUTPUT.dat " . "vr*" ); 

//Do the Interpolation 
£or(v = 0; v < HIBITS; V**) 
( 

for( i e 0 ; i < LOBITS; i+* ) 
( 

for( p = 0, out = 0; p < POINTS; p+* ) 
( 

sum ~ v ♦ p - POINTS/ 2 ; 
if (sum < 0) 

sum = 0; 
else if (sum > HIBITS - I) 

sum = HIBITS - 1; 

out *= fn(i)(P) * tabletsum] ; 
fprintf (fpl, *%d x %d -,fn(i)(p), tablefsumj ) ; 

) 

out /= FNBITS ; 

fprintf (fpl. ' =^ %u\n". out) ; 

fprintf (fp2. "%d \n'. out) ; 

//getcht); 

) 

> 

f close( fpl ) ; 
f close ( fp2 ) ; 
f close ( fp3 ) ; 
f close ( fp4 ) ; 
f closet fp$ ) ; 
£close{ fp6 ) ; 
f closet fp7 ); 
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Claims 

1 . A control point based real time primary custom gamma curve generator for color correction equipment, comprising: 

a separate custom gamma curve generator circuit is provided for each of the RBG and luminance channels; 
a control point random access memory (RAM) for storing a plurality of control points; 
a interpolation read only memory (ROM) for storing a precalculated interpolation function; and 
control means for receiving operator adjustments to values of the control points stored in the control point ran- 
dom access memory; 

means responsive to the instantaneous input signal for a given channel for accessing one of the control point 
values, and the immediately prior and subsequent control point values, and applying interpolation. 
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